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(54) Title: KALMAN EQUALIZATION IN MULTICARRIER RECEIVERS 
(57) Abstract 

A computer-implemented approach for reducing distortion 
in digital communications systems generally involves obtaining an 
optimal estimation of the original data using a Kalman filter with 
an increased length state to remove substantially all ISI in the 
time domain. The use of an increased length state in the Kalman 
filter provides a more accurate estimate of the transmitted data 
with relatively little additional computational cost Subsequent 
equalization may also be performed in the frequency domain to correct 
any residual amplitude and phase distortion. 
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KALMAN EQUALIZATION IN MULTI CARRIER RECEIVERS 



RELATED APPLICATIONS 

This application i$ related to U.S. Provisional Application Number 
5 60/123,348, entitled "KALMAN FILTER BASED EQUALIZATION FOR HIGH 
SPEED DIGITAL COMMUNICATION CHANNELS," filed March, 8, 1999 by 
SHANE MICHAEL TONISSEN, EFSTRATIOS SKAFIDAS and ANDREW 
LOGOTHETIS, the contents of which are incorporated herein by reference for all 
purposes. 

1 0 FIELD OF THE INVENTION 

The present invention relates to digital communications systems, and more 
specifically, to an approach for removing distortion in multi carrier digital 
communications systems such as Discrete Multi Tone (DMT) and Orthogonal 
Frequency Division Multiplexing (OFDM) systems. 

1 5 BACKGROUND OF THE INVENTION 

One of the most important concerns in digital communications systems is 
minimizing distortion introduced by a communications channel, sometimes referred 
to as "channel effects/' FIG. 1 is a block diagram 100 of a conventional digital 
communications system. Data is transmitted from a transmitter 102 to a receiver 104 

20 over a communications channel ("channel") 106. Channel 106 may be any type of 
communication medium for transferring data between transmitter 1 02 and receiver 
104. For example, channel 106 may be one or more network connections, wires, 
fiber-optic links or a wireless digital communications link. 

Ideally, data is transmitted between transmitter 102 and receiver 104 over 

25 channel 106 without being distorted. That is, the data retrieved by receiver 104 from 
channel 106 is identical to the data placed onto channel 106 by transmitter. 
However, in practice, channel 106 introduces distortion that can corrupt data 
transmitted over channel 106. The distortion introduced by channel 106 can cause 
successive transmitted symbols to interfere with each other, otherwise known as 

30 inter-symbol interference (ISI). ISI can cause severe corruption of digital data, 
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resulting in a very high bit error rate (BER). The corruption of data occurs while 
being transmitted across communications channel 106. In multi-carrier systems ISI 
must be removed before transformation of time domain data to frequency domain 
data, e.g., via a fast Fourier transform (FFT), which causes ISI to be spread across all 
5 frequency bins, producing significant signal to noise degradation. The common 
solution to this problem is to remove ISI from the sampled data using time domain 
equalization (TDEQ) before transforming the sampled data from the time domain 
data to the frequency domain. This allows the original data to be recovered from the 
communications channel. 
1 o FIG. 2 is a block diagram 200 illustrating an example implementation of 

transmitter 102 and receiver 104 of FIG. 1. Transmitter 102 typically includes an 
encoder 202, a digital-to-analog converter 204 and a transmit filter 206 and a line 
driver 207. Encoder 202 encodes the original digital data to generate encoded digital 
data. The encoded digital data is converted to analog encoded data by digital-to- 
1 5 analog converter 204. Transmit filter 206 removes unwanted components of the 

original data from the encoded analog data to generate filtered data. Line driver 207 
amplifies the signal to transmit the signal across channel 106. The filtered data is 
transmitted over channel 106 to receiver 104. 

Receiver 104 includes a differential amplifier 208, one or more receive filters 
20 209, an analog-to-digital converter 21 0 and an equalizer 212. After data is received 
by receiver 104 from channel 106, receive filter 209 removes unwanted components 
from the encoded analog data received from transmitter 102 over channel 106. 
Analog-to-digital converter 210 converts the encoded analog data received from 
transmitter 102 to encoded digital data. Equalizer 212 processes the encoded digital 
25 data to remove ISI. The encoded digital data is further processed by converting the 
data to the frequency domain via a Fast Fourier Transform to recover the modulated 
tones. Residual frequency domain equalization is performed in the frequency domain 
before the data is transferred to a decoder 214 that recovers the original digital data. 
Decoder 214 may be separate from receiver 104 as illustrated, or may be 
30 incorporated into receiver 104. 

Most conventional approaches for removing ISI have significant limitations 
that result in degraded performance. Many of the limitations in conventional 
approaches are attributable to the nature of ISI and the nature of other external noise 
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sources. Conventional approaches address each problem as independent, i.e., ISI 
removal and noise mitigation. Thus, solving one problem can exacerbate the effects 
of another. For example, some TDEQ mechanisms do not account for noise sources 
such as thermal noise and crosstalk. In addition, the characteristics (transfer 

5 function) of a communications channel are not necessarily static and can change over 
time. As a result, conventional TDEQ mechanisms suffer from a number of 
drawbacks generally including not removing all of the channel-induced ISI or having 
stability problems. For example, decision feedback TDEQ mechanisms can provide 
improved performance, but are difficult to apply to discrete multi-tone (DMT) 

0 transmission system applications, which limits their use. Furthermore, decision 
, feedback TDEQ mechanisms can suffer from error propagation problems, wherein 
the occurrence of one error leads to an increased probability of the occurrence of an 
error in the subsequent data symbols. As another example, transmission precoding is 
also used to compensate for known channel effects. However, transmission 

5 precoding requires an accurate characterization of the channel and a cooperative 

transmitter. Furthermore, transmission precoding cannot be implemented in all types 
of transmission systems. For example, transmission precoding cannot be 
implemented within the current asynchronous digital subscriber line (ADSL) 
standards ANSI T1.413 and ITU992.2. 

d Therefore, based on the need to reduce ISI in digital communications systems 

and the limitations in.the prior approaches, an approach for reducing ISI in digital 
communications systems, and in particular DSL communications systems, that does 
not suffer from limitations inherent in conventional ISI removal approaches is highly 
desirable. 

5 SUMMARY OF THE INVENTION 

According to one aspect of the invention, a computer-implemented method is 
provided for processing data received from a communications channel. First, the 
data is received from the communications channel, wherein the transmitted data 
consists of data modulated onto an arbitrary number of carriers. Then, a minimum 

3 mean square estimate of the data before the data was transmitted on the 

communications channel is determined. Finally, the minimum mean square estimate 
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is used to compensate for the distortion introduced into the data by the 
communications channel and also the external noise sources. 

According to another aspect of the invention, a computer-implemented 
method is provided for equalizing data received from a digital subscriber line, DMT 
5 or OFDM based communication system, to remove distortion in the data introduced 
by transmitting the data along a communications channel, e.g., a digital subscriber 
line. First, the data is received from the digital subscriber line. Then, a minimum 
mean square estimate of the data is determined using a Kalman filter. The minimum 
mean square estimate is used to compensate for the distortion in the data introduced . 

10 by transmitting the data on the digital subscriber line. 

"According to another aspect of the invention, a receiver is provided for 
equalizing analog data received from a communications channel, wherein the analog 
data includes distortion introduced by transmitting the analog data on the 
communications channel. The receiver comprises an analog front end (including 

1.5 filtering), an analog-to-digital converter and an equalizer. The analog-to-digital 

converter is configured to convert the analog data received from the communications 
channel to digital data. The equalizer is configured to determine a minimum mean 
square estimate of the analog data received from the communications channel and to 
use the minimum mean square estimate of the analog data to compensate for 

20 distortion introduced into the analog data by transmitting the analog data on the 
communications channel. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Embodiments of the invention are illustrated by way of example, and not by 
way of limitation, in the figures of the accompanying drawings and in which like 
25 reference numerals refer to similar elements and in which: 

FIG. 1 is a block diagram of a conventional digital communications system; 
FIG. 2 is a block diagram illustrating example implementations of the 
transmitter and receiver illustrated in FIG. 1; 

FIG. 3 is a block diagram of a communications system receiver implemented 
30 in accordance with an embodiment of the invention; 

FIG. 4 is a flow diagram illustrating an approach for removing distortion in a 
communications system according to an embodiment of the invention; 
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FIG 5 is a flow diagram illustrating an approach for determining an optimal 
FIG. 5 is a flow ai & fiUer wlth 

estimate of a single input sample of a data input q d 

=;r— - 

5 the invention may be implemented. 

DETAILED DESCRIPTION OE THE WVmTK* ^ 

In th e f o„o»m g »-Z£ZSZ*» It** — n. However, 
are set forth in order to provide a thorough un 

a ♦ -i Wemafter in the following sections: (1) functional 
described in more detail „ (4) freque ncy domain 

overview; (2) time domain equalization, V) F 
, 5 equalization; and (5) implementation mechanisms. 

1 FUNCTIONAL OVERVIEW 

I r u)n^ reducine distortion in digital 

communications systems generally tnvol q , mroduc(aJ by the 

. with an increased length state provm performed in 

accordance with an embodiment ^ ^ & 

"'-^ 
30 domain-to-frequency doma n onv * ^ ^ ^ 

The use of these components to process aigi 
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communications channel 106 is now described with reference to a flow diagram 400 
of FIG. 4. 

After starting in step 402, in step 404, analog encoded data is received from 
channel 106. 

5 In step 406, the analog encoded data is filtered by receive filter 302 to remove 

any undesired components from the received analog encoded data. 

In step 408, the analog encoded data is converted to digital encoded data by 
analog-to-digital converter 304. 

In step 410, time domain equalization is performed on the digital encoded 
10 data by time domain equalizer 306 to remove substantially all ISL According to one 
embodiment of the invention, performing time domain equalization involves 
determining a minimum mean square estimate (MMSE) of the original data using a 
Kalman filter to compensate for ISI introduced by channel 106. However, although 
embodiments of the invention are disclosed herein in the context of determining the 
1 5 MMSE using a Kalman filter, any mechanism may be employed for this purpose and 
the invention is not limited to any particular mechanism. In general terms, minimum 
mean square estimation is defined by: 



E[(x-x) 2 \y] 

A 

min* 
where : 

Eistheexp ected value 

x is the original data transmitted in the communications channel 
x is the output of the equalizer mechanism 

| is the conditional mean on y the output of the communications channel 

20 

Additional details and examples of the Kalman filter are described in more 
detail hereinafter. 

In step 412, the digital encoded data received from time domain equalizer 306 
is converted to the frequency domain by time domain-to-frequency domain converter 
25 308. Time domain-to-frequency domain converter 308 may incorporate any 



WO 00/54472 PCT/US00/06045 

techniques for converting the data, such as a fast Fourier transform, and the invention 
is not limited to a particular transformation technique. 

In step 414, frequency domain equalization is performed on the digital 
encoded data by frequency domain equalizer 310 to correct any residual amplitude 
5 and phase distortion, as described in more detail hereinafter. The process is complete 
in step 416. The data is then typically provided to a decoder to recover the original 
digital data. 

2. TIME DOMAIN EQUALIZATION 

According to an embodiment of the invention, a Kalman filtering technique 

10 with an increased length state, i.e., a.smoother, is used to remove, substantially all ISI 
from the received digital encoded data in the time domain by obtaining an MMSE of 
the original data. Kalman filtering, while never having been applied in nor 
considered for the context depicted in FIG. 3, is a well known technique for other 
uses in the field of mathematics. For example, see ''Optimal Filtering' 1 by B.D.O 

15 Anderson and J. Moore, Englewood Cliffs, N.J. Prentice Hall 1979 ISBN 

013631227. Referring to FIG. 2, data transmitted by transmitter 102 may be 
represented by a discrete time sequence x(k) that is processed by digital-to-analog 
converter 204 and transmit filter 206. The analog representation of the signal at the 
output of transmitter 102 is denoted by x(t). Channel 106 is characterized by its 

20 impulse response h(t). The output of channel 106, y(t), is then 

y(t) = h(t)*x(t) + n(t) (1) 
where x(t) is the channel input and n(t) accounts for all channel disturbances 
such as additive white Gaussian noise, crosstalk and echo noise. At receiver 104, the 
channel output y(k) is sampled to produce a discrete time received signal y(k). Thus, 

25 according to an embodiment of the invention, the goal is to obtain a discrete time 
estimate x (k) of the original discrete time signal x(k). 

It has been determined, in accordance with an embodiment of the invention, 
that the transmitted data sequence x(k) can be approximated by a white Gaussian 
sequence. This is due to the use of the inverse fast Fourier transform (IFFT) to 

30 generate the data samples and the fact that the symbols input to the IFFT are random 
in amplitude and phase and independent of each other. The approximate Gaussian 
nature of the data sequence is deduced from application of the central limit theorem. 
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Consequently, the white Gaussian assumption is best when the quadrature amplitude 
modulation (QAM) constellation size is large and the number of communications 
sub-channels is large. Any channel can be represented as an Auto Regressive 
Moving Average (ARMA) model by appropriate choice of the ARMA parameters to 
yield the actual channel impulse response. The channel output is well approximated 
by a white Gaussian input sequence driving an ARMA process, for which the 
Kalman filter yields the optimal estimate of the input sequence in the MMSE sense. 
The identified channel is represented by an ARMA model given by 

h^JM ■ m 

a(z) 



10 



£r, > h+bjZ Jtfe 2 -+£>* z m (3) 

" ^ Z '~ , - -1 - -2 , , - -m 
l + a^z +a 2 z +...+a m z 

where ao = 1 by definition and H (z) has impulse response h (k), as an 
estimate of the sampled channel impulse response h(k). The channel identifier may 
1 5 use the equalizer output to estimate the channel response adaptively. 

Kalman filter based equalization is implemented as follows according to one 
embodiment of the invention. First, a state ^(k) is defined to be a function of the data 
input and the denominator of the identified channel. Then the channel output is 
defined to be a function of the intermediate state £(k) and the numerator of the 
20 identified channel. These state and observation equations are given by: 



y(k) = B£(k)+n(k) & 



-8- 



WO 00/54472 



PCT/USOO/06045 



where A and B are derived from the identified channel parameters a(z) and 



b(2) 



A = 



-a x -a 2 -a 2 
1 .0 { 0 
0 10 



0 



-a m 0 



0 



0 
0 



0 



0 
0 
0 



(6) 



and are given by: 



B = [b 0 b\ -b m O - o] 



(7) 



It is assumed that a(z) and b (z) are of the same order m. If necessary, this 

can be achieved by padding the vector a or b with an appropriate number of zeros. 

In order to achieve a delay of "L" samples before the output is taken, the first row of 

A has "L+l " zeros after the a. elements. The remaining rows of A then consist of 
1 0 the "(L + m)x(L+m)" identify matrix and a column of zeros. Therefore, A is a 

"(L+m+OxCL-r-m+l)" square matrix. Similarly, the B matrix is extended with <£ L" 

zeros to form a "lx(L+m+l)" matrix. 

FIG. 5 is a flow diagram 500 illustrating an approach for determining an 

optimal estimate x (k) of a single input sample of the data input sequence x(k) using 
15 a Kalman filter with an increased length state according to an embodiment of the 

invention. The process is repeated for each successive input sample. After starting 

in step 502, in step 504, the initial state and covariance estimates for the Kalman 

filter are set to: 



£(010) = 



(8) 
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10 



20 



P(0|0) = 7 (9) 

To maintain consistency with the definitions of A and B, £ (. | .) has 
dimension "(L+m+l)xr/, and P(. | .) has dimension "(L+m+l)x(L+m+l)". The 
initialization P(0|0) reflects the assumption that the input data is a zero mean unit 
variance white Gaussian sequence. If the input data is not a zero mean unit variance 
white Gaussian sequence, then the initialization is modified accordingly i.e £ = % mean 
and P(0 | 0) = P 0 .In step 506, the state estimate and covariance predictions are 
determined as follows: 

£(k\k-\) = Ag(k-l\k-l) (10) 

P(k | k-l) = AP(k-l | k-l)A' + GQG' (11) 
where Q is the covariance of the data input x(k), which in this example is a 

scalar. 

In step 508, the innovations covariance is determined based upon the 
15 difference between the actual observation of the data and the data predicted from the 
state prediction. According to one embodiment of the invention, the innovations 
covariance is determined as follows: 

S(k) = BP(k | k-Y)B' + R (12) 
In step 510, the Kalman gain is calculated as follows: 



K(k)=P(k | k-\)B'S(ky l (13) 

In step 512, the updated state estimate and covariance matrix are calculated as 
follows: 



i(k I k)=£(k\k-l) + K(k)(y(k)-B£(k\ 

-10- 
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P{k | k )=P(k | k-\)-K{k)S(k)K{ky 



(15) 



i 



(16) 



While this is the simplest form of the covariance update, it may suffer from 
5 numerical instability. In practice, a numerically stable form of the update is used 

i e P{k\k) = [l- K(k)B(kM* I * " * -*(*)«*)] + " W ■ For farther 

details refer to »Stoc*«tfc M«Ms. «uf CWo/,» P.S. Maybeck, 

Academic Press, Vol. 1, 1979. 

In step 514 the data estimate is calculated from the intermediate state esUmat- 

1 0 as follows: 

x(k-\\k) = a£(k\k) 
where 

5=[0 ••• 0 1 a x •■■ a m \ 
consists of a with »L" leading zeros to achieve the »L» sample delay to "smooth" th 

1 5 data. 

The process is complete in step 516. 

The data estimate x (k-L|k) is the MMSE estimate of the data input x(k-L) gI ven 
received data up to time k and is the optimal estimate of the input data. If the 
channel characteristics do not change over time, then the filter gain and covanance 
20 converge to steady state values. In this situation, the Kalman filter becomes 
equivalent to a linear transverse filter. 

3 ADAPTIVE FILTERING 

in some situations, the characteristics of the channel change over time. Fo 
example, changes in ambient conditions or channel configuration can cause the 
25 channel characteristics to change. Therefore, according to an embodiment of the 
invention, adaptive Kalman filtering is employed to account for changes m chann. 
characteristics. Specifically, in situations where channel characteristics are chang 

-11- 
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over time, the updated channel parameter estimates denoted by A(k) and B (k) are 
used instead of the fixed matrices A and B . Furthermore, the Kalman filter yields 
the optimal gain K(k) that ensures the estimate x (k-L|k) is optimal. 

4. FREQUENCY DOMAIN EQUALIZATION 

5 In some situations, Kalman filter equalization may not provide exact 

equalization at all frequencies. Therefore, according to one embodiment of the 
invention, residual amplitude and phase distortion are corrected in the frequency 
domain. According to one embodiment of the invention, frequency domain 
equalization involves first determining the frequency response of the Kalman filter 

1 0 and then determining the required frequency domain equalization. Another 

embodiment would involve averaging a sequence of training data in the frequency 
domain to establish the gain dilation and phase rotation required for each QAM 
constellation in every tone and then applying this transformation to each 
constellation to the receive and transformed data transmission. 

1 5 a . Determining the Frequency Response of the Kalman Filter 

The first step in compensating for residual gain and distortion in the frequency 
domain is to determine the frequency response of the Kalman filter in the steady 
state. First, the steady state Kalman gain K ss is calculated, either by iteration or by 
solution of the Ricatti equation. Next, the transfer function of the Kalman filter 

20 equalizer in the z domain is calculated as follows: 

H eq (z)=a[(I-z- l )A + z- l K ss BAY K ss (18) 

Then the magnitude and phase of the frequency response at any desired frequency / 
is calculated by substituting z = j 2 * 1 in equation (18). The resultant complex valued 
transfer function is denoted H eq (/)- 

25 b. Determining Frequency Domain Equalization 

To determine the required frequency domain equalization, the overall transfer 
function from transmitted data sequence to time domain equalizer output is 
calculated by: 
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H total ( z ) = H(z )H eq (z ) (19) 

Note that in situations where all ISI has been removed during time domain 
equalization, U l0{3 \(J) is unity at all frequencies. The complex output of time domain 
to frequency domain converter 308 is denoted by X r (/). The frequency domain 
equalized output is then given by: 



XfdeqV)- *^* (2°) 

H total U) 

Where H lo tai(/) is obtained by substituting z=e i2 * / in equation (19) at the discrete set 
of frequencies corresponding to the frequency bins of the mechanism employed in 
1 0 time domain to frequency domain converter 308. X F deq(/) represents the recovered 
QAM symbols that are then passed to decoder 214. 

5 . IMPLEMENTATION MECHANISMS 

The approach for removing distortion in communications systems is 
applicable to any type of communications systems and is particularly well suited for 

15 broadband digital communications systems including wireless systems, cable modem 
systems, DSL applications and in particular, ADSL applications. Furthermore, the 
approach may be implemented as part of a receiver or a communications system, or 
as a stand-alone equalizer mechanism. The invention may be implemented in 
hardware circuitry, in computer software, or a combination of hardware circuitry and 

20 computer software and is not limited to a particular hardware or software 
implementation. 

Figure 6 is a block diagram that illustrates a computer system 600 upon which 
an embodiment of the invention may be implemented at least in part in computer 
software. Computer system 600 includes a bus 602 or other mechanism for 
25 communicating information, and a processor 604 coupled with bus 602 for processing 
information. Computer system 600 also includes a main memory 606, such as a 
random access memory (RAM) or other dynamic storage device, coupled to bus 602 
for storing information and instructions to be executed by processor 604. Main 
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memory 606 also may be used for storing temporary variables or other intermediate 

information during execution of instructions to be executed by processor 604. 

Computer system 600 further includes a read only memory (ROM) 608 or other static 

storage device coupled to bus 602 for storing static information and instructions for 

5 processor 604. A storage device 610, such as a magnetic disk or optical disk, is 

provided and coupled to bus 602 for storing information and instructions. 

Computer system 600 may be coupled via bus 602 to a display 612, such as a 

cathode ray tube (CRT), for displaying information to a computer user. An input 

device 614, including alphanumeric and other keys, is coupled to bus 602 for 

1 0 communicating information and command selections to processor 604. Another type 

of user input device is cursor control 616, such as* mouse, a trackball, or cursor 

direction keys for communicating direction information and command selections to 

processor 604 and for controlling cursor movement on display 612. This input device 

typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis 

1 5 (e.g., y), that allows the device to specify positions in a plane. 

The invention is related to the use of computer system 600 for removing 

distortion in digital communications systems. According to one embodiment of the 
invention, the removal of distortion in digital communications systems is provided 
by computer system 600 in response to processor 604 executing one or more 
20 sequences of one or more instructions contained in main memory 606. Such 

instructions may be read into main memory 606 from another computer-readable 
medium, such as storage device 610. Execution of the sequences of instructions 
contained in main memory 606 causes processor 604 to perform the process steps 
described herein. One or more processors in a multi-processing arrangement may 
25 also be employed to execute the sequences of instructions contained in main memory 
606. In alternative embodiments, hard-wired circuitry may be used in place of or in 
combination with software instructions to implement the invention. Thus, 
embodiments of the invention are not limited to any specific combination of 
hardware circuitry and software. 
30 The term "computer-readable medium" as used herein refers to any medium 

that participates in providing instructions to processor 604 for execution. Such a 
medium may take many forms, including but not limited to, non-volatile media, 
volatile media, and transmission media. Non-volatile media includes, for example, 
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optical or magnetic disks, such as storage device 610. Volatile media includes 
dynamic memory, such as main memory 606. Transmission media includes coaxial 
cables, copper wire and fiber optics, including the wires that comprise bus 602. 
Transmission media can also take the form of acoustic or light waves, such as those 
5 generated during radio wave and infrared data communications. 

Common forms of computer-readable media include, for example, a floppy 
disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD- 
ROM, any other optical medium, punch cards, paper tape, any other physical 
medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, 

10 any other memory chip or cartridge, a carrier wave as described hereinafter, or any 
other medium from which a computer can read. 

Various forms of computer readable media may be involved in carrying one or 
more sequences of one or more instructions to processor 604 for execution. For 
example, the instructions may initially be carried on a magnetic disk of a remote 

15 computer. The remote computer can load the instructions into its dynamic memory 
and send the instructions over a telephone line using a modem. A modem local to 
computer system 600 can receive the data on the telephone line and use an infrared 
transmitter to convert the data to an infrared signal. An infrared detector coupled to 
bus 602 can receive the data carried in the infrared signal and place the data on bus 

20 602. Bus 602 carries the data to main memory 606, from which processor 604 

retrieves and executes the instructions. The instructions received by main memory 606 
may optionally be stored on storage device 610 either before or after execution by 
processor 604. 

Computer system 600 also includes a communications interface 618 coupled 
25 to bus 602. Communications interface 618 provides a two-way data communications 
coupling to a network link 620 that is connected to a local network 622. For 
example, communications interface 618 may be an integrated services digital 
network (ISDN) card or a modem to provide a data communications connection to a 
corresponding type of telephone line. As another example, communications 
.30 interface 61 8 may be a local area network (LAN) card to provide a data 

communications connection to a compatible LAN. Wireless links may also be 
implemented. In any such implementation, communications interface 618 sends and 
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receives electrical, electromagnetic or optical signals that carry digital data streams 
representing various types of information. 

Network link 620 typically provides data communications through one or 
more networks to other data devices. For example, network link 620 may provide a 
5 connection through local'network 622 to a host computer 624 or to data equipment 
operated by an Internet Service Provider (ISP) 626. ISP 626 in turn provides data 
communications services through the world wide packet data communications 
network now commonly referred to as the "Internet" 628. Local network 622 and 
Internet 628 both use electrical, electromagnetic or optical signals that carry digital 
1 0 data streams. The signals through the various networks and the signals on network 
link 620 and through communications interface 618, which carry the digital data to 
and from computer system 600, are exemplary forms of carrier waves transporting 
the information. 

Computer system 600 can send messages and receive data, including program 
1 5 code, through the network(s), network link 620 and communications interface 618. 
In the Internet example, a server 630 might transmit a requested code for an 
application program through Internet 628, ISP 626, local network 622 and 
communications interface 618. In accordance with the invention, one such 
downloaded application provides for the removal of distortion in digital 
20 communications systems as described herein. 

The received code may be executed by processor 604 as it is received, and/or 
stored in storage device 610, or other non-volatile storage for later execution. In this 
manner, computer system 600 may obtain application code in the form of a carrier 



wave. 



25 The novel approach described herein for reducing distortion in digital 

communications systems provides several advantages over prior approaches. A 
significant advantage is that elimination of substantially all ISI in the time domain 
allows data rates to approach the theoretical capacity of the communications channel, 
as defined by Shannon's theorem. Another advantage is that the approach can be 

30 implemented to operate on the received encoded data without requiring any changes 
to the transmission mechanism. The approach also provides inherent stability with 
no error propagation. Finally, the approach is applicable to. DSL protocols and in 
particular, the ADSL and VDSL protocol. Thus the approach is compatible with 
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ADSL/VDSL, DMT and OFDM transmitters without requiring changes to the 
ADSL/VDSL, DMT and OFDM transmitters. 

In the foregoing specification, the invention has been described with 
reference to specific embodiments thereof. However, various modifications and 
5 changes may be made thereto without departing from the broader spirit and scope of 
the invention. The specification and drawings are, accordingly, to be regarded in an 
illustrative sense rather than a restrictive sense. 
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CLAIMS 

What is claimed is: 



1 1 . A method for processing data received from a communications channel, the 

2 method comprising the computer-implemented steps of: 

3 receiving the data from the communications channel, wherein the data is 

4 modulated onto an arbitrary number of carriers and includes distortion 

5 introduced by the communications channel; 

6 determining a minimum mean square estimate of the data before the data was 

7 transmitted on the communications channel; and 

8 using the minimum mean square estimate to compensate for the distortion 

0 . «, introduced into the data by the communications channel. 

1 2. The method as recited in Claim 1 , wherein determining a minimum mean 

2 square estimate of the data before the data was transmitted on the 

3 communications channel includes processing the data using a Kalman filter. 

1 3. The method as recited in Claim 2, wherein processing the data using a 

2 Kalman filter includes processing the data using a Kalman filter with an 

3 increased length state. 

1 4. The method as recited in Claim 1, further comprising after using the 

2 minimum mean square estimate to compensate for the distortion introduced 

3 by the communications channel, 

4 transforming the data from the time domain to a frequency domain to 

5 generate frequency domain data, and 

6 removing residual amplitude and phase distortion from the frequency domain 

7 data in the frequency domain. 

1 5. The method as recited in Claim 1, wherein: 

2 the communications channel is a digital subscriber line, 

3 the step of receiving the data from the communications channel includes 

4 receiving the data from the digital subscriber line, and 
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5 the step of determining a minimum mean square estimate of the data before 

6 the data was transmitted on the communications channel includes 

7 determining a minimum mean square estimate of the data before the 

8 data was transmitted on the digital subscriber line, and 

9 the step of using the minimum mean square estimate to compensate for the 

10 distortion introduced by the communications channel includes using 

1 1 the minimum mean square estimate to compensate for the distortion 

1 2 introduced by the digital subscriber line. 

1 6. The method as recited in Claim 1, wherein: 

2 the data is received from a Multicarrier communications system, 

3 the step of receiving the data from the communications channel includes 

4 receiving the data from a digital subscriber line, and 

5 the step of determining a minimum mean square estimate of the data before 

6 the data was transmitted on the communications channel includes 

7 determining a minimum mean square estimate of the data before the 

8 data was transmitted on the digital subscriber line, and 

9 the step of using the minimum mean square estimate to compensate for the 

10 distortion introduced by the communications channel includes using 

1 1 the minimum mean square estimate to compensate for the distortion 

12 introduced by the digital subscriber line. 

1 7. A method for equalizing data received from a digital subscriber line to 

2 remove distortion in the data introduced by transmitting the data on the 

3 digital subscriber line, the method comprising the computer-implemented 

4 steps of: 

5 receiving the data from the digital subscriber line; 

6 determining a minimum mean square estimate of the data before the data was 

7 transmitted on the digital subscriber line using a Kalman filter; and 

8 using the minimum mean square estimate to compensate for the distortion in 

9 the data introduced by transmitting the data on the digital subscriber 
10 line. 
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1 8. The method as recited in Claim 6, wherein determining a minimum mean 

2 square estimate of the data before the data was transmitted on the digital 

3 subscriber line using a Kalman filter includes determining a minimum mean 

4 square estimate of the data before the data was transmitted on the digital 

5 subscriber line usmg a Kalman filter with an increased length state. 

1 9. The method as recited in Claim 7, wherein determining a minimum mean 

2 square estimate of the data before the data was transmitted on the digital 

3 subscriber line using a Kalman filter with an increased length state includes: 

4 determining initial state and covariance estimates for the Kalman filter, 

5 determining state estimate and covariance predictions, 

6 determining an innovations covariance, 

7 determining a Kalman gain for the Kalman filter, 

8 determining an updated state estimate and covariance matrix, and 

9 determining a data estimate based upon the updated state estimate. 

1 10. The method as recited in Claim 6, further comprising 

2 after using the minimum mean square estimate to compensate for the 

3 distortion in the data, transforming the data from the time domain to a 

4 frequency domain to generate frequency domain data, and 

5 removing residual amplitude and phase distortion from the frequency domain 
■ 6 data in the frequency domain. 

1 11. The method as recited in Claim 9, wherein removing residual amplitude and 

2 phase distortion from the frequency domain data in the frequency domain 

3 includes averaging a sequence of training data in the frequency domain to 

4 establish a gain dilation and phase rotation required for each QAM 

5 constellation in every tone and then applying the transformation to each 

6 constellation in the received and transformed data transmission. 

1 12. The method as recited in Claim 9, wherein removing residual amplitude and 

2 phase distortion from the frequency domain data in the frequency domain 

3 includes 

4 determining a frequency response of the Kalman filter, and 
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5 determining a transfer function from the data before the data was transmitted 

6 on the digital subscriber line to the data received from the digital 

7 subscriber line. 

1 13. A receiver for equalizing analog data received from a communications 

2 channel, wherein the analog data includes distortion introduced by 

3 transmitting the data on the communications channel, the receiver 

4 comprising: 

5 one or more receive filters; 

6 one or more amplifiers; 

7 an analog-to-digital converter configured to convert the analog data received 

8 from the communications channel to digital data; and 

9 an equalizer configured to determine a minimum mean square estimate of the 

1 0 data received from the communications channel and to use the 

1 1 minimum mean square estimate to remove the distortion introduced 

12 by transmitting the analog data on the communications channel. 

1 14. The receiver recited in Claim 1 1 , wherein the receiver further comprises a 

2 Kalman filter for determining the minimum mean square estimate of the data 

3 received from the communications channel. 

1 15. The receiver as recited in Claim 12, wherein the Kalman filter is a Kalman 

2 filter with an increased length state. 

1 16. The receiver as recited in Claim 1 1 , wherein the communications channel is a 

2 digital subscriber line and the analog- to-digital converter is configured to . 

3 receive and convert the analog data from the digital subscriber line to digital 

4 data. 

1 17. A computer-readable medium for processing data received from a 

2 communications channel, the computer-readable medium carrying one or 

3 more sequences of one or more instructions which, when executed by one or 

4 more processors, cause the one or more processors to perform the steps of: 
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5 receiving the data from the communications channel, wherein the transmitted 

6 data is modulated onto an arbitrary number of carriers and includes 

7 distortion introduced by the communications channel; 

8 determining a minimum mean square estimate of the data before the data was 

9 transmitted on the communications channel; and 

10 using the minimum mean square estimate to compensate for the distortion 

j I introduced into the data by the communications channel. 

1 18. The computer-readable medium as recited in Claim 15, wherein determining 

2 a minimum mean square estimate of the data before the data was transmitted 

3 on the communications channel includes processing the data using a Kalman 

4 filter. 

1 19. The computer-readable medium as recited in Claim 16, wherein processing 

2 the data using a Kalman filter includes processing the data using a Kalman 

3 filter with an increased length state. 

1 20. The computer-readable medium as recited in Claim 1 5, further comprising 

2 instructions which, when executed by the one or more processors, cause the 

3 one or more processors to, after using the minimum mean square estimate to 

4 compensate for the distortion introduced by the communications channel, 

5 transform the data from the time domain to a frequency domain to generate 

6 frequency domain data, and 

7 remove residual amplitude and phase distortion from the frequency domain 

8 data in the frequency domain. 

1 21. The computer-readable medium as recited in Claim 1 5 , wherein: 

2 the communications channel is a digital subscriber line, 

3 the step of receiving the data from the communications channel includes 

4 receiving the data from the digital subscriber line, and 

5 the step of determining a minimum mean square estimate of the data before 

6 the data was transmitted on the communications channel includes 
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7 determining a minimum mean square estimate of the data before the 

8 data was transmitted on the digital subscriber line, and 

9 the step of using the minimum mean square estimate to compensate for the 

1 0 distortion introduced by the communications channel includes using 

1 1 the minimum mean square estimate to compensate for the distortion 

12 . introduced by the digital subscriber line. 
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